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Abstract: We study a new non-classical class of variational problems 
that is motivated by some recent research on the non-linear revenue 
problem in the field of economics. This class of problem can be set up as 
a maximising problem in the Calculus of Variations (CoV) or Optimal 
Control. However, the state value at the final fixed time, y(T), is a priori 
unknown and the integrand is a function of the unknown y(T). This is 
a non-standard CoV problem. In this paper we apply the new costate 
boundary conditions p(T) in the formulation of the CoV problem. We 
solve some sample examples in this problem class using the numerical 
shooting method to solve the resulting TPBVP, and incorporate the 
free y{T) as an additional unknown. Essentially the same results are 
obtained using symbolic algebra software. 
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1 Introduction 

The first result of the calculus of variations ever discovered must have been the 
statement that the shortest path joining two points is a straight line segment. 
Another classical variational problem consists in finding, amongst all simple closed 
plane curves of a given fixed length, one that encloses the largest possible area. 
It is well known since ancient times that the circle is the shape that encloses 
maximum area for a given length of perimeter. However, it was not until the 
eighteenth century that a systematic theory, the Calculus of Variations (CoV), 
began to emerge. A modern face to the CoV is given by the theory of optimal 
control. Economics is a source of interesting applications of the theory of calculus 
of variations and optimal control. Classical examples include the optimal capital 
spending problem, optimal reservoir control, optimal production subject to royalty 
payment obligations, optimal maintenance and replacement policy, and optimal 
drug bust strategy [5, 10]. 

The following economics problem (explained briefly here) has motivated this 
paper [11]. A standard feature of the theory of the firm is that a profit maximising 
firm facing a downward sloping demand curve reacts to an increase in marginal cost 
by reducing output and increasing price. In this context, it is well understood that 
a requirement to pay a flat-rate royalty on sales has just this effect of increasing 
marginal cost and thereby decreasing output while simultaneously increasing price. 
However, the effect of permitting the royalty to take on more general forms leads 
naturally to non-standard CoV problems, and explains why this question has 
remained unaddrcssed to date [11]. Recently the effect of picccwisc linear cumulative 
royalty schedules on the optimal intertemporal production policy, i.e., an optimal 
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economics control problem that does not fit into the classical class of variational 
problems, has been formulated [11]. The economics problem lies in the area of 
Repayable Launch Investment (RLI). For the purposes of this paper we will outline 
just the mathematical nature of the problem since the precise (nonlinear) economic 
details are of secondary importance here. Consider the system in the time domain 
modelled by the differential equation 

y'(t) = u(t) , i/(0) known 

with the endpoint state value y(T) at time t = T unknown. We wish to determine 
the control function u(t) for t € [0, T] that maximises the return 

JH-)] = [ f(t,y(t),u(t),y(T))dt. 
Jo 

Note that the integrand depends upon the a priori unknown final value y(T). This 
class of problem is not contained within the classical class of variational problems 
and the present paper indicates how such problems may be solved. 

The manuscript is organized as follows. In Section 2 we develop the necessary 
conditions for the cxtrcmising solution. The main idea is borrowed from Malinowska 
and Torres [6], where appropriate natural boundary conditions are proved for 
problems of the calculus of variations on time scales [2]. We then consider 
two approaches to obtain the solution of a sample example with a continuous 
integrand / (Section 3). The first approach considers the numerical shooting 
solution (Section 4). The results obtained are then validated by symbolic algebra 
computations (Section 5). Wc finish with conclusions in Section 6. 



2 The non-classical variational problem 

We begin by developing the necessary conditions for the extremising solution. Let 
J be a functional of the form 

J[y(-)} = f f(t,y(t),y'(t),y(T))dt 

where 

(t,y,y',z) -» f(t,y,y',z) 

is a smooth function and T > a. We consider the problem of determining the 
functions y(-) G C 1 such that J[-] has an extremum. An initial condition y(a) = a 
is imposed on y(-), but y(T) is free. 

Suppose that </[•] has an extremum at y(-). We can proceed as Lagrange did 
(cf. [4]), by considering the value of J at a nearby function y = y + sh, where e is a 
small parameter, h(-) € C 1 , and h(a) = 0. Because y(T) is free, we do not require 
h(-) to vanish at T. Let 



0(e) = J[(y + eh)(-)\ = / /(t, y(t) + shit), y'(t) + eh'(t), y{T) + eh{T))dt 

J a 
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A necessary condition for y(-) to be an extremizer is given by 



0'(e)Uo = O^ / [f y (---)h(t)+f y ,(---)h'(t) + f z (---)h(T)}dt = 0, (1) 



where (• 



(t,y(t),y'(t),y(T)). Integration by parts gives 



f y , (••• )h'(t)dt =fy,(-- -)h{t)Y a - / -(f y ,(...))h(t)dt. 



Because h{a) = 0, the necessary condition (1) can be then written as 



/.(-)-£/✓(-) 



h{t) 



f v , {T,y{T),y'{T),y{T)) 
T-a 



+ /.(•••) 



/i(T)|di (2) 



for all h(-) <G C 1 such that h(a) = 0. In particular, equation (2) holds for the subclass 
of functions h(-) <G C 1 that do vanish at h(T). Thus, the classical arguments apply, 
and therefore 



/„(■ 



rff 



(3) 



Equation (2) must be satisfied for all h(-) S C 1 with /i(a) = 0, which includes 
functions h(-) that do not vanish at T. Consequently, equations (2) and (3) imply 
that 



fy, (T,y(T),y'(T),y(T)) 
T-a 



+ /.(■-) 



h(T)dt = 



^ft(T) /^(T,y(T),y'(T),y(T))+ / f z (---)dt) =0 



that is, 



f v ,(T,y(T),y'(T),y(T))+ / /,(•••)* = . 



(4) 



We remark that in the classical setting / does not depend on y(T), that is, 
f z = 0. In that case (4) reduces to the well known natural boundary condition 
fy, (T,y(T),y'(T)) = (or, from an Hamiltonian optimal control perspective, 
p(T) = 0). We have just proved the following result: 

Theorem 2.1: Let a and T be given real numbers, a <T. Ify(-) is a solution of 
the problem 



(5) 



J[y(-)} = / /(*, V(t), V'(t), y(T))dt — + extr 
y(a)=a (y(T) free) 
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then 

j t f v , (t, y(t),v'(t),y(T)) - /„ (t, y(t),y'(t),y(T)) (6) 

for all t G [a, T]. Moreover, 

f y , (T, y(T), y'(T), y(T)) = - f f z (t, y{t),yf{f), y(T)) dt . (7) 

J a 

Remark 2.2: From an optimal control perspective one has 

p{T)=f y . (T,y(T),y'(T),y(T)) , 

where p(t) is the Hamiltonian multiplier. Theorem 2.1 asserts that the usual 
necessary optimality conditions (the Euler-Lagrangc equation [4] or the Pontryagin 
maximum principle [8]) hold for problem (5) by substituting the classical 
transversality condition p(T) = with 

P(T) = - [ f z (t,y(t),y'(t),y(T))dt. (8) 



3 An illustrative example 

We consider an example that illustrates the new class of CoV problem. It has the 
same form as the complicated nonlinear optimal intertemporal production policy 
problem. Consider the ODE system described by 

y'(t) = u(t), y(0) = 0. (9) 

We wish to maximise 

JH-)}= [ f(t,y(t),u(t),z)dt (10) 
Jo 

where 

/3 \ 

(11) 



/(t, y, u, z) = ay/u — (— + z sin(7rt/10)^ u 



is a continuous function. The initial known state is y(0) = and final state value 
z = y(T) is free. In this example we set T = 10. The Hamiltonian is H(t, y, u,p) = 
— f + p ■ u and 

(y'(t)=H p (t,y(t),u(t),p(t)) 
\p'(t) = -H y (t,y(t),u(t),p{t)). 

Function / does not depend on y, and for an optimum (maximum in this example), 
the costate satisfies 



p = -H y & p' = . 



(12) 
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The stationarity condition is 



H u = 
and this yields 



u(t) = i(zsin(7rf/T0) -p(t) f . (13) 



From (8) 



p(t) = - I f z (t,m,v'(t),y(T))dt 



holds, i.e., 



p(T) = I sin(7rt/10) u(t) dt . (14) 



4 Numerical shooting algorithms 

Let us consider the necessary conditions (NC) that need to be satisfied. For the 
system of ODEs (9) and (12) with control (13), the known zero initial condition 
y(0) and a guessed initial value p(0), we need to ensure that the natural boundary 
condition (14) is satisfied. 

We need to solve the two point boundary value problem. Also we need to iterate 
the value of z used in (13) to ensure that in fact the value z equals the value obtained 
for y(t) at t = T. When one has obtained convergence regarding the values y(T) 
used in (13) and p(T) (14), then NC is satisfied and we should have the optimal 
solution. 

Use the Newton shooting method with two guessed values v\ and v-i [1]. We 
desire v\ = p(0), and V2 = p(T) as specified by equation (14). When the program 
obtains results with these two equations holding to a very high degree of accuracy, 
the necessary conditions NC hold and we should have the optimal solution. We have 
solved the shooting method problem using C++ and the highly accurate Numerical 
Recipes library routines [9]: 

(i) We integrate the system (y(t),p(t), g p (t), J{t)), i.e., the system of ODEs (9) 
and (12), and 

g' p = 8in(7rf/10)u(t) , 
J'=g. 

The results are y{T) = 0.86928249597392515, p(T) = -0.46111638323272386, 
g p (T) = -0.46111638323273074, and 



J(T) = 1.85448307363352 



(15) 
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Perturbations of the optimal control u(t) by increasing and decreasing the value of 
u(t) at a single time instant yield smaller J(T) values. Sec Figure 1 for results on 
state variable y(t) and control variable u(t). 

A completely different approach, using a nonlinear programming technique, was 
also used. This technique may be useful for the actual piecewise constant economics 
problem. We solved this problem using Euler and Runge-Kutta discretisation, 
and an optimisation algorithm to solve for the unknown control variables Uk at 
each time instant tk- We computed the nonlinear programming problem using 
AMPL [3] with the MINOS solver and NEOS [7]. Using 40 time steps yields a 
good approximation very similar to the optimal results obtained using the precise 
approach here described. 



5 Symbolic algebra solution 

Consider the ODE system (9) and the associated optimal control problem described 
by (10) and (11). We set this as a minimization problem. From (10) define 

JmH-)] = [ g(t,y(t),u(t),z)dt (16) 
Jo 

where 

g(t, y, u, z) = -f{t, y, u,z)= ^ + z sin(7rf/10)^ u - ay/u (17) 

with the final state value z = y(T) free, and T = 10. We now use the Euler-Lagrange 
equation (6) to find candidate solutions: 

j t gy (t, m,y'(t),v(T)) = g y it, m, y'(t),y(T)) 

for all t E [0, T]. Set u = y' and z = y(T) so 

jj.9y'(t,y,y',y( T )) = ^.9u{t,y,u,z) 



d /3 1 /vrf 



dt \4 2y/u~ \10 
,'ttA u' 

= T^KZ COS — + 



10 V 10 / 4 « 3/2 ' 

Since g y = 0, using (6) we can find u by solving 

1 /ttA u'it) 

-TTZ COS 1 



10 V 10 / 4w(t) 3 /2 

Next result was obtained using Maple: 

1 

U(t) = 7T 

( C + 2zsin(fl)) 2 
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We find easily y from y' = u using integration, e.g.. in Maple or Mathematica: 

20 (- tan' 1 (2z/D) g(t)c 2 + h{t)g(i)J - zD (- cos {%) c + g(t))) 

v{t) = I^dW) (18) 

where 

D = \/c 2 - 4z 2 , 
git) = I c + 2zsin 



= tan 1 



7rf 

To 

2z + ctan 



, 20 J 



2 



Some comments: 



• The function h is not defined for t = 10. However one can define h for t = 10 
as 



lim tan" 1 ' ^ 



7T 



\ Vc 2 - 4z 2 y 2 

• Theorem 2.1 assumes u € C°. 

• From (17) u(t) > 0. If u = we have J = and we see that this is not the 
best solution. So u > and z = y(T) > 0. 

• We must verify c 2 — 4z 2 > (see D in (18)) so two cases are to be 
investigated: c > 2z and c < — 2z. 

Recall (7): 

V (T, y(T), y'(T), y(T)) = - [ g z (t, y(t), y'(t),y(T)) dt . (19) 

J a 

We have 

g z (t,y,u,z) = usin (j^J 

and using u(-) we arrive to 

sin (Tn) 
( C + 2zsin(f)) 

Integrating for the branch c > 2z we obtain 

10 , .„ , u 20(2tan- 1 (%) z - ttz + L>) 
«? z (t, y(t), y{T)) dt = — ^ ^ ^ 



n 



The left-hand side of (19) is 

g y , (T, y (T),y'(T),y(T)) = ±(3-2c). 
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Figure 1 Optimal pair (y(t),u(t)) to problem (9)-(10) obtained from both symbolic 
computation and the shooting method. 

Solving equation (19) numerically we get c = 2.42223 and z = 0.869282. The 
objective value is J m = —1.85448 obtained using numerical integration over (16). 
This compares favorably with the result (15). Note that similar calculations for the 
branch c < — 2z < provide a worse solution with J m = +6.62857 (c = —7.21816 
and z = 3.14287). 

The results obtained here by Symbolic Algebra Computations (SAC) are in 
accordance and validate the numerical shooting solution obtained in Section 4. 



6 Conclusion 

In this note we have shown how the standard necessary optimality conditions 
and numerical procedures for problems of the calculus of variations and optimal 
control should be adapted in order to cover Lagrangians depending on the free 
end-point. The numerical techniques were validated with a simple sample example 
that allows symbolic calculations using a modern computer algebra system. In the 
actual optimal intertemporal production policy economics problem the Lagrangian 
may be piecewise continuous and this requires amended numerical techniques, such 
as nonlinear programming, for its solution. This numerical solution approach will 
be important for solution of the actual nonlinear economics problem. 
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